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ABSTRACT 

Hiddle and apper class 3- and 4-year-old children 
were exposed to three consecutive 5'«eek treatment ,conditions in the 
naturalistic setting of a half-day laboratory nansery school prograa. 
Daring the first treatment condition^ the teacher eaphasized lo« 
level cognitive qnestions; during the second, high level cognitive 
questions; and during the third, low level cognitive questions. The 
level of teacher*s cognitive deaands for all treatment conditions was 
classified according to the observational instruaent, the Individual 
Cognitive Deaand Schedule (ICDS) . Subjects significantly increased 
their scores on two vertal problea solving tasks following exposure 
to high level cognitive questioning and significantly decreased their 
scores on the saae tasks following exposure to low level cognitive 
questioning. (Author/CS) 
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AMSTRACT 



TEAOIER LEVEL OF QUESTIONING AND 
PROBLEM SOLVING IN YOUNG CHILDREN 

Middle and upper class three- and four-year-old children were e)q>osed to 
throe consecutive five-week treatment conditions during the naturalistic set- 
tinp In a ha If -day laboratory nursery school program. During the first treat- 
ment condition, the teacher emphasized low level cognitive questions; during the 
second, high level cognitive questions; and during the third, low level cognitive 
questions. Ss significantly Increased their scores on two verbal problem solving 
tasks following exposure to high level cognitive questioning and significantly de- 
creased their scores on the same tasks following exposure to low levdl cognitive 
questioning. 
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TEACHER LEVEL OF QUESTIONING AND 
PROBLEM SOLVING IN YOUNG OilLORbN 

Ir&dltlonal ly^ instructional programs In American education have strongly 
emphasized the goal of transmitting subject matter content. However, It Is be- 
coming increasingly more difficult and less feasible to base curricula on the 
acquisition of facts. During the past decade early childhood educators have 
begun to recognize the importance of the development of Intellectual operations 
other than those associated with factual knowledge. 

Young children are faced with countless problems of various types and dimen- 
sions In their day-to-day Interactions with both home and school environments. 
It appears that being e)q)osed to a setting which emphasizes the transmission of 
factual knowledge is Inadequate in helping the child to develop styles of think- 
ing which enable him to seek effective solutions to problems. 

As an area of study, problem solving has received its share of attention In 
the psychological literature. The single impression that emerges from ttie abundance 
of literature In the area Is that there is little consensus on the definition of the 
problem solving process as a mode of thinking. Definitions vary In elaborateness 
and ernphases. For example, Gagne (1964) describes problem solving as the most 
complex type of human learning, the pinnacle of the learning hierarchy. He differ- 
entiates problem solving from other forms of learning in that the learning situation 
never involves behavior which could by simple summation constitute the criterion 
performance, and what is learned must be general Izab le to a class of problems. 

A quite different assumption is made by Guilford and his associates who do 
not consider problem solving as a cognitive operation, but as a broad concept 
which cannot be located In the system of intellectual facrors. Each instance 
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of problem solving Is thought to draw upon Its own particular combination of 
Intellectual resources, depending on the nature of the problem and th^ strate.]y 
of the problem solver (Hoepfner, 1969). 

Shaftel and Crabtree (1963) see problem solving as essentially a "search" 
for solutions to situations that have novel elements In them. They maintain 
that the process of search Is as Important as answers or products. 

Freeman and Stern (1972) describe eight distinct abilities that underlie 
proDlem solving, two of which are fluency and flexibility. These same two 
abilities nave been described by Guiiforo as aspects of divergeni- thinking. 
The former investigators conside/ problem solving as the highest level thlnklnq 
skill which integrates those eig^t analytic abilities. 

These and other definitions of problem solving, however, do seem to include 
at least three aspects: discovery, novelty, and general iz^ibl I Ity. 

Given that problem solving is an important process in the young child*s 
overall development, teachers need to be concerned with the growth of problem 
solving facility of the young children under their direction. Only a few investi- 
gators have emphasized the teacher*s questioning as a basic technique for guiding 
young children through the "search" or "inquiry" process (Blank, 1973; Estvan, 
1969; [aba and Elzey, 1964; and Zimmerman and Bergen, 1971), 

A number of studies have been conducted using elementary and high school 
students as subjects to measure the teacher's level of questioning and its effects 
on students' performance (Davis and Tinsley, 1967; Gallagher and Aschner, 1963; 
flunk ins, (960; Hunter, 1969). The results of these studies indicate that teachers 
at jli lovels are asking an overwhelming percentage of questions which fall In 
Mie factual, recall categories, with questions requiring expression of hi()ner 
v.oMni;ive processes being virtually absent from the classroom. 
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I'owcver, It seems that tho few programs which havo been dor>(nncd for the 
r^perifJc purpose of improving teachers* questloninq practices nave been offoc- 
llvo in mooting this goal (borg, ef p±., 1970; Farloy, 1963; [Houston, 1938). 
In addition, there Is some evidence to support the notion that when tecicners 
have boon trained to ask higher level questions, performance of students Improves, 
at I }cist immediately following exposure to such questions (riunkins, 1968). 

Unfortunately investlnaMons In the area of teacher questioning and how If 
rninht relate to facilitating problem solving abilities with nursery school and 
kindergarten children is almost non-existent. In fact, teacher questioning at 
this level has been almost totally neglected in empirical research. The present 
study was designed to give so^c^ Insight Into the effects of a teacher's level 
of questions on certain problem solving tasks performed by the young children 
under her direction. 
Method 
Subjects 

Subjects were thirteen cnildreoy six females and seven males, enrolled In 
one ciass In a laboratory nursery school, three hours a day, four days a week. 
The mean age of Ss was 49 months; mean IQ was 107; all Ss were classified as having 
either high or middle SES (Warner, I960). 
P^re-^ and Post- test Measures 

Shaftel Photo Problems. This measure attempted to determine the child's 
ability to generate verbal alternative solutions to selected prohJem situations. 
Ss were shourn individually three large photographs, each depicting a problem 
believed to be familiar to most young children. These photos are part of the Words 
^PJ ^^^IQ" Program ; R ole Pl aying Photo-^problems for Young Chi Idren < Shaf te i and 




Shaffel, I967). E Identified the problem depicted In the picture for the child 
and asked him to generate as many verbal solutions to the problem as he could. 
The chl Id was asked after each response If there were any other solutions until 
he indicated he could think of none. 

Similarities Test. This measure was developed by Smotherglll, Olson, nd 
Moore (1971) and consists of a series of small toys or other objects similar In 
several different ways. Each was shown objects In pairs and was asked to 
generate as many verbal similarities as he could between the two. Again the S 
was asked after eacn response if there were any other possible similarities until 
he Indicated there was none. 

Testing was done by an experimenter unfamiliar with the nature of the study. 
Pre- and post-test sessions were tape-recorded for analyses of responses. The 
total nunter of alternative solutions generated for the problem situations and the 
total number of similarities generated between pairs of objects were computed from 
the tape recordings. 

A reliability coefficient of the pre- and post-test Instruments was obtained 
by d test-retest method on a random sample of fifteen children enrolled In other 
classes at the laboratory school. .94 was obtained for the Shaftel Photo Problems 
measure and .91 for the Similarities Test measure. 

To assure equivalence of the different forms for the pre- and post -tests of the 
SIml larltles Test, both forms wore administered at the same sitting to the above 
random sample of fifteen children with a correlation coefficient of .93 being 
obtal ned. 

J ^Icatlon System for t oding Teacher Questions 

in this paper the term ''cognitive demands" Is used to refer to questions (and 
occasionally statements) by the teacher which appear to place demands on the cognitive 
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processes of the children to whom they are directed. The teacher's cognitive 
demands for all treatment conditions were classified according to the observational 
Instrument, the Individual Cognitive Demand Schedule (ICDS) (Lynch and Ames, 1971). 
This Instrument categorizes cognitive demands on a continuum with each type of 
demand being a unique combination of several features of cognition, with each level 
placing somewhat more complex demands on the child than the one preceding It. 
The instrument Includes four low level categories, seven high level categories, 
and two non-cognltlve categories not used In the study. Specifically, according 
to the ICDS, questions that can be classified as requiring the following re- 
sponses from the child are considered low level questions: Habitual Responding, 
Obs^^rvlng-DIscrlmlnatlng, Stringing, and Remembering. Those questions which 
require the following responses from the child are classified as high level: 
Explaining, Def Inlng-ClassI fy Ing, Applylng-Comparing, Inferring, Making Bel leve. 
Value Judging, and Problem Solving. Prior to the Inception of the study, the 
Invesflgator, using video tapes, established an Inter-rater rellabllty coeffi- 
cient with two other observers of .85. 
Teac h er Training 

During the summer before the collection of the data the teacher participating 
In the study learned all eleven categories of the ICDS to be used In the study, 
using the training booklets provided by the developers of the Instrument. Coding 
of video tapes constituted further training until the Investigator was certain 
that the teacher could use and distinguish between low and high level categories. 
The data presented below confirm that she was sufficiently trained to use the ap- 
propriate categories for each treatment condition. Participating students who each 
spent three hours a week In the laboratory were trained In a similar manner. 
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todj n of Cognitive Demands^ Du ring Treatment Condi tlon s 

Pie teacher's cognitive demands were coded during the naturalistic setting 
of the entire da. ly session of each day of each treatment condition, for a total 
of 60 days. Each time the teacher asked a question (or made a statement) which could 
be classified as a cognitive demand, the observer recorded on a data sheet the 
category of the demand and the child to whom It was directed. Because of the open 
fracnework environment an observer was able to code only one adult at a time. Con- 
sequently, due to the number of participating students and the absence of aval lable 
observers, only the teacher hei^uif was coded. Student participators were observed 
from time to time to determine If they were asking questions appropriate to the 
designated level for the treatment condition. Two observers shared the coding with 
an Inter-rater reliability esbabllshed at .88. 
Treat ment Conditions 

The design for the present Investigation was a Treatments-by-SubJects, or 
Repeated Measures, Design, which analyzed the effects of successive e)^erlmentdl 
manipulations on one group of Ss (Bruning and Kintz, 1968). Ss were tested after 
each of three treatment conditions, rendering for each a pretest score and three 
post-test scores. Each treatment condition lasted five weeks, or a total of 20 days. 

During the first treatment condition, the teacher restricted her cognitive 
demands. Insofar as possible, to the four low level categories of the ICDS. Imme- 
diately following post-testing, the second treatment condition began, during which 
the teacher eliminated her use of low level demands. Insofar as possible, and made 
use of all seven categories of high level demands of the ICDS. During the third 
and final treatment condition the teacher again reverted to the use of low level 
demands, restricting high level demands as much as possible. This treatment condl- 
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tlofi was included In the design to strengthen the possibility that If chonno^ |n 
Ss* porformance occurred In the expected direction at the end of ench trontrrifjnf 
condirlon, then these changes would more likely be the result of differential treat- 
mnnt conditions rather than the result of maturation, nursery school experience, etc. 

During all treatment conditions children were participating in their normal 
iiursory school activities. No attempt was made to alter the environment In any way 
excopt In the level of questions asked by the teacher. The teaching situation re- 
mained natural. No specific tasks were assigned. The teacher merely used the de- 
signated levels of cognitive demands in every appropriate situation throughout each 
day of the treatment. 
Results 

During the first treatment condition the teacher made a mean nurflber of 66 low 
level cognitive demands and 2.95 high level demands per day. Computed on a percen- 
tage basis, low level cognitive demands comprised fron^ 87 to 100^ of the teacher's 
dally demands, with high level demands occurring from 0 to \3% of the time. 

During the second five-week treatment condition, the teacher made a mean 
number of 26.55 low level cognitive demands and 101.4 high level cognitive demands 
per day. On a percentage basis, low level cognitive demands were made on Ss from 
14 to 50% of the time, with the exception of day 15, when the teacher's low level 
demands comprised 36^ of the total. High level cognitive demands during the 
second treatment condition comprised 70 to 66% of total questions, with the excep- 
tion of day 15, when the percentage only reached 64$. 

During the third and final five-week treatment condition, the teacher made a 
mean number of 59.6 low level cognitive demands and 3.35 high level cognitive 
demands per day. Low level demands ranged from 82 to 100$ of total dal ly cogni- 
tive demands, with hiqh level demands ranging from 0 to 18$. 
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Ihese data Indicate without statistical treatment that there were subsfanMal 
differences In the nunter of high level and low level cognitive demands made of fh« 
Ss In each of the three treatment condl+;ons, with the first treatment condition 
emphasizing low level cognitive demands; the second, high level demands; and the 
third, a return emphasis to low level demands. 
Pre- and Po st-test Scores on the Shaftel Photo Problems 

Mean scores and standard deviations obtained on the Shaftel Photo Problems 
for the four testing periods are reported In Table I. 



Insert Table I about here 



An analysis of variance for a repeated measures design (Bruning and KIntz, 
I96«) was performed for this measure on the four sets of data (Table 2). 



Insert Table 2 about here 



It can be seen from Table 2 that the obtained F value of 12.75 was significant 
beyond the .001 level of confidence. To detannine where the differences lay, a _t 
test for correlated data (Bruning and KIntz, 1968) was used to test the difference 
between the mean scores of: the pretest and the first post-test, the first and 
second post-tests, and the second and third post-tests. 



Insert Table 3 about here 



table 3 Indicates that a t of 1.41 was obtained between the mean scores on 
the protest and the first post-test, after Ss were exposed to a treatment condlHo»> 
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emphasizing low level cognitive demands, with this difference being statistically 
non-slgnif leant. In fact, Ss slightly Increased their mean score on this m^^sure 
from 7.15 to 8,38 (Table I). 

A 1^ of 8.78 (p <..00!) was obtained for the difference between the means of 
the second and third post-tests (Table 3). Ss' mean scores Increased from 8.38 
to 15*85 (Table I) after being exposed to a treatment condition emphasizing high 
level cognitive demands. 

Finally, a t^ of 3.79 (p <.0I) was ootalned for the difference between the 
mean scores of the second and third post-tests, after Ss were again exposed to a 
treatment condition emphasizing low level cognitive demands (Table 3). It may 
be noted (Table I) that Ss* mean scores decreased from 15.85 to 10.08 after the 
third treatment condition. 

These data Indicate that there was no significant difference between the mean 
number of alternative solutions that Ss ge jrated to the Shaftel Photo Problems 
after an Initial exposure to a treatment condition emphasizing low level cognitive 
demands. In addition, Ss generated a significantly greater nunter of alternative 
solutions to the problems measure after being exposed to a treatment condition 
In which the teacher emphasized high level cognitive demands. Finally, Ss 
generated significantly fewer alternative solutions to the Shaftel Photo Problems 
after being exposed to a treatment condition in which the teacher again emphasized 
low level cognitive demands. 

Pr e- and Post -test Scores on the SimI lari ties Test Measure 

/ean scores and standard deviations were calculated for the Similarnies fes'r 
measure for each of the four testing periods (Table 4). 



Insert Table 4 about here 
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following the same procedure described above, an analysis of varlanco for a 
ropoat d measures design (Bruning and Klnfz, 1968) was performed for this measure 
on tho four sets of data (Table 5). 



Insert Table 5 about here 



As reported in Table 5, the obtained F value of 26.15 for this measure was 
sinnif leant beyond the .001 level of confidence. Again/ to determine where the 
differences lay, a t test for cor:- lated data (druning and Kintz. 1968) was used 
to test the difference betwepr. the mean scores of: the pretest and the first posN 
test; the first and seconu post-tests^ and the second and third post-tests. 



Insert Table 6 about here 



Table 6 Indicates that a t of .126 was obtained between the mean scores on the 
prefest and the first post- test. Even though Ss slightly Increased their mean score, 
from 8.15 to 8.30 (Table 4), after being e)q)osed to a treatment condition emphasizing 
low level cognitive demands, this difference was statistically non-slgnl f leant. 

A t of 8.27 (p < .GDI) was obtained for the difference between the mean scores 
of the second and third post-tests (Table 6). Ss' msan scores Increased from 8.30 
to 18.31 on this measure (Table 4) after being exposed to a treatment condition 
emphasizing high level cognitive demands. 

Finally, a t of 7.25 (p <.00l) was obtained for the difference between the mean 
scores of the second and third post-tests (Table 6), after Ss had been exposed to tfie 
fhird treatment condition, which again emphasized low level cognitive demands. It 
may be noted (Table 4) that Ss' mean scores decrease ' 'rom 18.31 to 9.46 after ^he 
final treatment condition. 
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Therefore, It Is clear that there was no significant difference between the 
fnpan number of similarities Ss generated between familiar objects after being 
exposed to an initial treatment condition emphasizing low level cognitive demands. 
In line with their rerponses to the Shaftel Photo Problems, Ss generated a greater 
number of simi larltles between objects after being exposed to a treatment condition 
In which the teacher emphasized high level cognitive demands. SImilarlv, Ss generated 
significantly fewer similarities between objects affer being exposed to a final treat- 
ment condition in which the teacher emphasized low level cognitive demands. 
Di s c uss ion 

The data presented above strongly suggest the importance of the role of 
teachers In promoting the growth of problem solving facility In the young children 
under their direction. More specifically, the data seem to support the thesis 
that exposure to the teacher's high level cognitive questioning results In children's 
ability to generate significantly more alternative solutions to problems^ as well as 
significantly more similarities between familiar obj^.ts In their environment, two 
abilities seen by the Investigator as being among several abilities Involved In 
the total process of problem solving. However, the data should be viewed as sug- 
gestive rather than Indicative, due to the size and homogeneity of the sample. 

The data Indicate that the children in the study did not significantly change 
their performance on the two problem solving measures after the first treatment con- 
dition. This is hardly surprising In view of the possibility that whatever "naturally 
occurring*' cognitive maturation which normally would be evident might have been 
offset by the lack of any attention on the part of the teacher to high level cogni- 
tive qupc+ioning. Or It Is possible that even low level questioning may have had 
SOTO slight positive effect on these abilities, by helping children to approach 
prohlems in a more questioning manner. 
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The extremely significant increase In scores on both nwasures after the 
second treatment condition (from 8.38 to I5.85 on the Shaftel Photo Problems and 
from 8.30 to 18.31 on the Similarities Test) was somewhat surprising to the in- 
vest I oa for, who had not anticipated significant differences greater than at the 
.01 level of confidence, at best. On examining the data on the teacher's number 
of total questions In each of the three treatment conditons, one possible ex- 
planation occurs. It should be recalled that during the first treatment condi- 
tion emphasizing low level cognitive demands, the teacher made a mean number of 
66 low level demands per day, or a total of 1,320 for the five-week period, while 
she made only 2.95 high level demands per day, for a total of 59. 

On the other hand, when the teacher shifted to the second treatment condition, 
which emphasized high level cognitive demands, she made a mean number of 101.4 
of this type per day, or a total of 2,028 high level cognitive demands for the 
entire period. Her mean of 26.55 low level demands per day resulted In a total 
of 531 for the entire period. 

Looking at these figures. It is easy to see that the teacher asked almost 
twice as many total questions during the second treatment ^nditlon as during the 
first. Further, the fact that she emphasized the appropriate level of questions 
to a far greater extent during the second condition than during the first suggests 
the possibi lity that this particular teacher may have found It easier to ask high 
level than low level questions, or that she was Influenced by her knowledge of tt.- 
general nature of the study. These factors, either alone or In combination, might 
offer some Insight Into the highly significant increase In scores following Ss* 
exposure to high level cognitive demands. 

Ihe third and final treatment condition emphasized low level questions, in 
terms of total number of questions asked by the teacher, the third treatment condl- 
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tion was little different from the first, with a mean number of 59.6 low level 
demands or a total of i,l92, and mean number of 3.35 high level cognitive demands 
per day for a total of 67. It should be noted that Ss did. In fact, significantly 
decrease their scores on both measures after the thfrd treatment condition, but 
scores did not fall as low as they had been prior to any exposure to high level 
questioning. These data suggest that either there may have been some slight re- 
sidual effects of previous high level questioning, or that scores would naturally 
increase somewhat from the pretest as a result of maturation and/or experience not 
related to questioning, or as a result of experience In testing. Since the differ- 
ences between the first post-tests and the Third post-tests were rather small, one 
of fhe latter explanations seems more likely. 

In general, the results of the present study are consistent with results of 
other studies conducted with older children concerning the effects of teachers* 
questions: on pupil performance. Unfortunately, studies of this nature are scarce, 
especially with teachers of nursery and kindergarten children. However, a few 
investigators have ascertained that an elaborated code on the part of the adult 
working with a young child produced cognitive styles more conducive to problem 
solving and reflection, with the use of questioning to help the child search for 
solutions to problems being a vital aspect of an elaborated code (Bee, et al . , 
1969; Hess and Shipman, 1965; SmotherglSI, Olson^ and floore, 1971). 

The present study differed from those above In tvo major ways: first, only 
the lovel of questioning was manipulated, with other aspects of adult verbalization 
such as support and elaboratlve statements being excluded; second, children were 
expound to the treatment condition daily for the duration of the naturalistic 
sett inn rather than for short periods of specialized teaching sessions apart from 
the naturalistic setting. 
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One of the most encouraging Imp ! I cations of the prnsent Investigation Is thaf 
opp'irontly a teacher can be trained to effectively ask high level qtjostlons In the 
naturalistic setting with young children. It seems that the use of an Instrument 
such as the I ndl virtual Cognitive Demand Schedule can be an effective teacher train- 
ing tool to help teachers become aware of the kinds of questions they are asking 
In tho classroom and to help them change their question-asking techniques so that 
they can better foster desirable thinking ski I Is In the young chl Idren whom they 
teach. 
Summary 

In summary, the present Investigation suggests that exposure to high level 
cognitive questions in the naturalistic setting Is Instrumental In producing ai 
least temporary gains In scores on certain problem solving measures In young 
children. Specifically, the study lends credence to the hypothesis that young 
chl Idren generate a significantly greater number of alternative solutions to 
problems presented and a significantly greater number of similarities between 
familiar objects after being exposed to high level cognitive questioning In 
their dally nursery school activities than they do after being exposed to low 
level cognitive questioning. 
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TAULt I 

MfcANS AND STAf-lUARU DLVIATIWS OF THE SHAFTbL PfK)TO 
PROBLEMS FOR FOUR TESTING PERIODS 



Testing Period 


X 


s. tr.. 


Pretest 


7.15 


2.8 


Post- test 1 


8.38 


3.43 


Post-test II 


15.85 


3.61> 


Post-test III 


10.08 


4.88 




TABLE 2 







ANALYSIS OF VARIANCE FOR REPEATED MEASURES 
Ur IHt on/\rltL rnUiU rKUtSLtMo 




Source 


SS df ms F 


P 


Total 


1506.16 51 




Subjects 


405.58 12 




Treatments 


567.08 3 189.02 12.75 


<.00l 


Error 


533.5 36 14.82 





TABLE 3 

t TESTS FOR DIFFERENCE BETWEEN MEANS OF PRE- AND 
POST-TESTS OF THE SHAFTEL PHOTO PROBLEMS 



fteans Tested i_ p 

Pretest 4 Post-test I 1.41 N. S. 

Post -rest I 4 Post-test II 8.78 <.00l 

Post-test II 4 Post-test III 3.79 <.0I 



ERIC 



0 0 019 



TAULL 4 



MtANS Ai^D STAInIUARD DCVIATIOfviS OF THt SIMILARITILS 
TEST FOR FOUR TESTING PERIODS 



T' Stloq I'erlod 



fYelest 
Post-fest- I 
Post tost I I 
Post-fest III 



8. 15 
8.30 
18.31 
9.46 



S. D. 

5.04 
5.8 
5.4C 
6.09 



Source 



TAULi£ 5 

ANALYSIS OF VARIANCE FOR REPEATED ilEASURLS 
OF THt Sini LARITIES TEST 



ss 



df 



ms 



Total 
Subjects 
Trnatments 
i rror 



2660.99 
1366.24 
895.60 
399.15 



51 
12 
3 
36 



298.80 26.15 <.00l 

11.08 



TABLE 6 



t TESTS FOR DIFFERENCE BETV/EEN fEANS OF PRE- AND 
POST-TESTS OF THE SIMILARITIES TEST 



Proi'";t ^ Post-test I 
Post -test I i Post-test 1 1 
Po-t ««st II A Post-test III 



.126 
8.27 
7.25 



N. S. 
^.OOI 
< .00 1 



ERIC 



r- n i\ 2 0 



